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REPORT ON IIS NETWORK HISTORY 



jh-> 1984-85 proposal for the Management of Instructional Information 
Systems project indicates that a project objective was "to create arrange- 
ments through which interested individuals in districts and schools can 
have low cost access to both research based and field based knowledge" (p. 
7). One of the arrangements which was to be created was a network of 
interested districts. We formed a network of districts which had become 
involved in managing instructional change by linking testing data and eval- 
uative data with other district operations. This network had as its 
nucleus districts with which we had already worked, or who had been 
involved with related CSE projects, or who had worked with other NIE funded 
research efforts. We contacted professional organizations, state depart- 
ments, university and college instructors who we thought were interested in 
this area. 

This document first provides a rationale for creating a network of 
educators interested in Information systems and then lists the activities 
which occurred within the Network. 

Rationale for an IIS Network 

Information systems in education are a newly emergent phenomenon about 
wh^h there are more questions than answers. A first set of fundamental 
questions deals with the significance of information systems in educational 
settings. Are information systems a passing fad in education occasioned by 
the push of technology and the burgeoning of Information systems in the 
private sector. Are they basically incompatible with the personal, clini- 
cal, situation-specific nature of education and learning? If not, should 



or can they be adopted to fit the organizational and educational 
requirements of schools? Will the process of adaptation change both the 
nature of the technical system and the nature of the host institution? 
Will such changes be helpful or harmful? 

A second set of questions deals with the general as well as specific 
purposes of information systems in educational settings. What kinds of 
information can be supplied to educators that are better than, different 
from, more precise than, what 1s already available to them from ot^er 
sources or from their own experience? Who will benefit from educational 
information systems in the short run, in the long run? If the list 
includes students, parents, teachers, administrators, and the public, then 
we must ask when, how, and under what circumstances? A third set of poten- 
tial questions arise around the development and operation of Information 
systems. These are the most readily surfaced and fall Into technical, 
managerial, training and budgeting categories, among oters. 

We find, then, a bewildering array of issues surrounding this emergent 
phenomenon. We also find that no single individual, or even groups of 
individuals within a single specialty have all the answers. Computer 
experts, software developers, systems analysts, management consultants, 
evaluators, educators — each of these has a professional perspective on a 
small piece of the whole. Furthermore, because information systems are a 
complex socio-technical innovation, the experts 1 perspectives may not pro- 
vide definitive answers about what to do; they may only be able to suggest 
directions or methods for how to proceed with addressing the known and the 
to-be-discussed array of issues. 



This situation of complexity and uncertainty calls for 
interdisciplinary cooperation and interaction. All the more is this 
necessary given the decentralized, pluralistic nature of the public school 
setting and the situation-specific needs of local schools and districts. 

Planning for and development of information systems in education will, 

therefore, not occur using a blueprint model of planning whereby "a 

centralized determination of public purpose will be made." Rather, it will 

likely use a social learning paradigm. 

In this model, the characters of actor, inquirer and planner- 
theorist are intermixed and the process of "planning" comes to 
be embedded in the undifferentiated process of the action 
itself, ... If v;e now look further at this practice-based 
learning, we find that it relies on a process that, by combin- 
ing two kinds of knowledge - personal and theoretical or 
"processed" knowledge - yields an understanding greater than 
either could have produced by itself. . . . The process of 
grafting personal on processed knowledge may be called mutual 
learning , because it generally involves people with different 
abilities and skills who decide to work together on a common 
problem-solving task. Insofar as they do this, they learn 
from each other and from the situation so that the cognitive 
maps of both are in the end transformed. 

John Friedman, Retracking America , 
Rodale Press Inc., 1981 

Networks have characteristics which make them excellent arrangements 

for facilitating mutual learning. Among them are the following: 

Hholeparts - people and organizations which function simultaneously as 
Independent whole and interdependent parts. 

Shifting levels - functional levels related to tasks (e.g., clerical, 
managerial) shift from person to person, with a single individual 
performing tasks at different levels at different times. 

Distinguished power and responsibility - information, power and 
authority along horizontal lin;s from person to person or organization 
to organization, as contrasted to a bureaucracy where information 
slows up and power flows down. 

Fly-eyed and Hydra-headed - Ne*#orks encourage many perspectives about 
goals and means but come together from time to time around essential 
common values and directions. Leadership likewise is fluid and 
shifts depending on task and phase. 
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Permanency of relationships - Networks are open, have loosely defined 
requirements for membership, are linked through personal contact, a 
sense of shared collective purposes. 

(Friedman, 1981) 
Networks usually have components which keep them going: 

1) a problem-oriented goal with facilitating objectives; 

2) voluntary participants concerned with the goal; 

3) an information exchange or clearinghouse; 

4) a facilitating staff; 

5) temporary cooperative projects; 
{Parker, 1977). 

Networks usually have a life cycle : 

1) Isolated innovators and problem solvers 

2) Informal contact networks 

3) Deliberate informal networks 

4) Building a formal network 

5) Institutionalizing the network 

6) Dissipation of the network's spirit 
(barker, 1977). 

The particular elements in building a formal network include: 
an agreed-upon name 
a formal statement of purpose 
a directory of participants 
a catalog of participants 1 programs 
releases for publicizing the network 
designated facilitators or coordinators 
an exchange or facilitating center 
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a newsletter or bulletin 
surveys of participants 1 needs and resources 
meetings for planning and trouble-shooting 
an annual or semi-annual conference 
various cooperative projects 
(Parker, 1977). 

IIS Network Activities 

October 1983 - Questionnaire to district personnel. About 25 question- 
naires were returned by districts indicating that they ►»(! an instruc- 
tional information system, that they wanted to expand or improve that 
system, that they would be interested in learning what other districts 
did, and that they would like to participate in a network. 

February 1984 - Brainstorming session with nine people from district and 
County office personnel who agreed that: 1) there are things, 
nationally and in California, th-t have stimulated interest in IISs 
and related Issues (e.g., Senate Bill 8iJ; new CAP requirements); 2) 
there is already a lot of data collected by districts and schools but 
there are problems in formulating the analysis questions that will 
provide maximum use of the data for decisionmaking at various levels; 
3) districts need information regarding hardware and software: and 4) 
there are management Issues about how to develop IISs that districts 
and schools already have experience with. It was agreed that sharing 
of these experiences could be helpful. 

March 1984 - A Status Survey was distributed to 61 Southern California 
school districts. The survey was designed to collect information 
about: 
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0 level of Interest 1n network participation; 
0 activities that a network should do; 

0 level of interest in a directory of individuals interested in an 
IIS network and a brief description of their agency activities; 

0 current district IIS activities; 

0 district IIS interests/needs. 

Survey response . Sixty-one districts received letters and the 
survey, asking for their views on an IIS network. From the 37 indi- 
vidual responses to the survey (a 57% response rate) from 33 different 
agencies we gleaned the following information: 

Preferences for network activities . Network activities that most 
respondents expressed interest in: a newsletter, collections of exem- 
plary materials, tips/techniques/tools, seminars, working conferences, 
workshops, exchange of visits among members, and the development of 
guides or manuals. Most respondents were not Interested in a toll- 
free phone line, personnel exchange, or long-term consultation. 

Seventy-five percent (n = 27) of respondents said they would like 
to have their name and a brief description of their agency's activi- 
ties Included in an IIS directory. Eighty-six percent (n = 31) said 
they would like to receive such a directory. 

Current district IIS activities . Over 70% of institutions indi- 
cated that they administer norm-referenced tests, computer analyzed 
data, and provide staff and boar^ orientation to data interpretation. 
About 60% collect some type of non-achievement data, know how their 
tests match their curriculum and textbooks, provide different 
information to different users, and have established a delivery system 
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for reporting data to different groups of users. Fewer than 42% have 
a way to use data for policy purposes, use commercial software for 
data analysis, or have district computer facilities with terminals at 
local sites. Fewer than 20% of respondents have a taxonomy of 
questions to ask of the data. 

About 60% collect some type of non-achievement data, know how 
their tests match their curriculum and textbooks, provide different 
information to different users, and have established a delivery system 
for reporting data to different groups of users. Fewer than 42% have 
a way to use data for policy purposes, use commercial software for 
data analysis, or have district computer facilities with terminals at 
local sites. Fewer than 20% of respondents have a taxonomy of 
questions to ask of the data. 

Agency IIS interests . They wanted more information about: 
° how their tests match their curriculum and our textbooks; 
° a way to use data for policy purposes; 
° a taxonomy of questions to ask of the data; 

° delivery systems for reporting data to different groups of users; 

° coordinating the management of evaluation, staff development, and 
instruction. 

May 1984 - IIS Network News , Vol. l f No. 1 containing write-in notices from 
Network members about "Good Ideas," Help Wanted," "Resources," 
"Noteworthies" was mailed to 103 individuals. 

June 1984 - IIS Network Mini-Conference . This 25-perscn one-day mini- 
conference started with six ten-minute presentations: 1) Tom Martin, 
ABC Unified School District - Using a Microcomputer to Marage a High 



School Proficiency System: One District's Experience; 2) Leigh 

Burstein, CSE - Simi Valley School Survey; 3) Joan Herman, CSE - 

Matching Tests with Curriculum; 4) Carol F. Thomas, SWRL - 

Administrator Software; 5) Jim Burry, CSE - Scoring Writing Samples; 

6) Millie Murray, Hillsborough County (FL) Schools - MI IS Systems: 

Problems Solved, Unsolved, & Unanticipated. 

Following this, small group sessions raised questions about 

information systems as they might affect policy making, administration 

and instruction, A participant observer from project staff made the 

following comments: 

School people came with a general agenda - hearing what others 
had to say, finding out a bit about what was going on, seeii:g 
what might develop from this network thing. They did not come 
with a list of specific activities that they wanted h*lp with, a 
goal that they were seeking ways to achieve, etc. Overall, many 
also came as much to tell or present as to learn. 

Most people are in a primitive stage of development of anything 
like an IIS. People are still concerned with how to <*et data up 
and running, with how to figure out "where students pre," with 
exactly what role data can play in a political decisionmaking 
context, with ethical issues. Perhaps the Network session played 
a useful function in allowing people to recognize that others 
share their concerns, that there are no firm and fixed answers 
out there that "everyone but me M knows about. 

But the presence of this new IIS potential also means that dis- 
trict administrators (and perhaps board members) need new skills 
- they need to be more adept politically; they need methodologi- 
cal skills to engage intelligently in debates generated by or 
based on information; they need to set policies (for both ethical 
and political reasons) detailing who has access to which informa- 
tion at what stages in the gathering-analysis-presentation cycle 
and which information is privileged; etc. So, we can provide a 
service for Networkers not only by helping them ^earn about and 
see software, hardware, and whole systems that are well along or 
up and running. We can also facilitate by identifying and pre- 
senting those who can move issues off the current spot of level 
and onto a more advanced one (where more advanced means more 
sharply defined, redefined, reconfigured, etc.). 
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October 1984 - IIS Network News , Vol. l f No. 2 containing Inquiries about 
the formation of special Interest groups, site visits, as well as 
M' ni-Conference highlights, an article summary, software package 
reviews, and a Network directory was mailed to 118 individuals. 

February 1985 - The CSE conference, " INVENTING THE F iURE: THE DEVELOPMENT 
OF EDUCATIONAL INFORMATION SYSTEM S," Included roany members of the 
Network (see write-up in IIS Network Newsletter , Vol.2, No. 1). 

October, 1985 - IIS Network Newsletter , Vol, 2, No. 1, containing a report 
on the February 1985 conference, as well a "Reader's Digest," a 
summary of conference presentations, and brief "Personals - Who's 
Doing What?" was sent to 150 Individuals. 
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A tBVSLBTTIR ABOUT IBSTRUCTIOMAL IWFORMATIOM SYSTEMS* 

Vol.2, no.l October 2985 



Dear Network News Readers, 

Welcome to what may be the last Issue of the IIS Network News, The 
Management of Instructional Information Systems project at UCLA s Center 
for the Study of Evaluation has been organizing network activities through 
funding provided by the National Institute of Education. Our current 
funding grant runs out at the end of November 1985. We have a new grant 
proposal currently under consideration, but we won't know about refunding 
until the 1st of next year. At that time we hope we will be sending you 
greetings and welcoming you back to the Network. 

In the event that our sponsorship of the Network does not continue, we 
hope that you will keep up your communlcatlor with one another. From what 
we hear. Individuals and groups around the ccuntry are trying out various 
uses of computerized systems to provide information for instructional 
decisionmaking. To help you contact one another, we are Including an 
updated roster of current Network members. 

Other features of this issue of the Network News Include; 
• highlights of presentations made at the conference we hostjd last 
February (see IIS UPDATE below); 

- summaries of information systems interests of participants at the 
February conference; 

- reviews of journals that contain features related to Information 
systems. 

It's been a pleasant and productive, 1f all too brief, association 
with Network meters who have kept us apprised of their activities, 
questions and concerns. Hopefully, the connection will continue. If you 
have questions or concerns you'd like to raise with us. please call before 
December 1st (213) 206-1536. 



IIS UPDATE 

Last February we hosted a conference - "INFORMATION SYSTEMS AND SCHOOL 
IMPROVUMENT: Inventing the Future" - v.ich brought together educators and 
researchers who are Involved In the development of IIS. Due to severe budget 
restrictions, we were forced to limit the number of participants and could 
not accommodate all members of the IIS network. In the following pages . we 
have pMrite. excerpts from conference presentations. We have also *™ed 
descriptions of needs and Interests Identified by some conference partici- 
pants. The conference proceedings will be published by Teachers College 
Press this coming year. 



b^st copy 

ERIC 



•Produced by Adrlanne Bank and Richard C. Williams. Directors, Management 
of Instructional Information Systems Project, CSE/UCLA. High level 
assistance by Elaine Craig. 
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HAVE YOU SEEN THESE PUBLICATIONS? 



The information technology field 1s so new that those ; of us Involved I In 

KnT * T^Xl - fU » e?ch kn ot 2, SB 

S see what n« *Xlog1cal wonder has arrived to Improve our productivity. 

He hooe tnat through the Network you have been talking to each other about your techno- 



jtf 

Oriented to the educational community; "** 



have found helpful ard Interesting. 

AEDS Journal Published by the Association for 

mcrlcomputer Software," "Administrative Uses of the Microcomputer, and The Micro 
computer and the Administrative Office. 

Mutat ional Technology Subtitled "The Magazine for Managers 
of Change In Eduction." this . journal ^ Vgf °" ^Hf ^fVmat^n syT- 

sr;. rsss 

(March 1985). 

n, rtron1c Education This journal Is primarily classroom 

ferent applications from word processing to telecommunications, ine uses 
especially targeted to classroom teachers' management needs. 




Oriented toward the business community: 

Business Conpu ter System' Subtitled "The Magazine for 
Business Computer Management," the Sep'Tmber , j»ue , features J^^gr 1 2°lSr 
tlon centers, software for project management and base P" 9 ™ 5 W 

needs. Each Issue contains evaluations of hardware and software. 

PC This publication offers current Information on 

hardware and software for I BM- type eBp.fr t. ffJF^ 1 *^^*™* 
section entitled "Shopping for Performance and Price which presents guioe 
cost yet effective Hardware and software. 

Popul ar Cggutlno Subtitled "Improving Productivity for 

and deals with ethical Issues sue. as copy-protection and piracy. 

For those who -ant to keep up wUh the l.te « Mj te jy^J^'^^Jtt.fSI: 
ware and software, two of the mcst popular journals a e PC won a. tocusi g 
compatibles, and BYTE, the small systems journal. 
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"INVENTING THE FUTURE: THE DEVELOPMENT OF EDUCATIONAL INFORMATION SYSTEMS" - 
Proceedings of the February 1985 Conference win be published next year by 
Teachers College Press. Here are brief summaries of some papers. 

In "Instructional Information Systems: Dream or Nightrare." Michael Q. 
Patton asks us to examine THO MAJOR ISSUES: "What Is -ort now ng? .« How 
can Me oet people to use Information?" He sees the game of Trivial Pursuli as 
of the Information age at Its most ^"J^^b^m^cu^d acTu- 
great promise In computer-generated Information that Is VnblM^Mus*. accu 
rate, explicit, and understandable. "The real challenge In the Infection age 
Is asking the right questions." 

Walt Hathaway sees ANOTHER CHALLENGE, one that calls for an organizational 
revolution fueled by the availability of computerized distributive Ration 
Sterns More specifically. Hathaway makes a strong case for "bottom-up 

rM i to t^ creation o/'lnfcrmatlon systems In paral lei with the n sal 06.- 
tlon of management control and Instructional decisionmaking back Into the class 
rool T«chers who are now viewed as data originators should become both data 
users and policy makers. 




a CDHTRArriMG PERSPECTIVE: "It might seem Irrational for me to suggest 
♦h.t the l^n^tlon of a comprehensive Information system , with Its « J| 
organizational ramifications would not necessarily result In ^ucatlonal 

^ nt " So «ys y D?ck Harsh. Vrmer Director of ETS. Los Angeles. In his paper 
"What About Information Systems and School Improvement? 



Nirk nussault Coordinator of Research and Evaluation, Sheboygan (WI) Area 
Se ^VlSTt^pof."?..! that 0JTIMAL USE of « Information sys em 

requires a diagnostic/prescriptive o r1cnt4 « 0 " to 9, - F or those schools 

not the first step. Changing classroom instruction Is the first step. 



i«n Kino in "Maklnq Instructional Information Systems Teacher Friendly." 
scnts the teacher s poinx ot view »" wa iil. 1v reactions of classroom 

2 irr^rsr,'. errs ™£«£ ; 

teacher participation. 



T„ . Durban Los Angeles Hgh school. Slrotnlk and Bursteln helped 
. J JmSm ' WTA from a student attitude survey with an ongoing 
Ht ^"SSStl^i. Working with the high school sUfU tjjy 

system and making reports to teachers on easy-to-read single pages. 
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Cannings and Polln report on a survey of thlrtv high schools where they 
investigated the COMPUTER AS AN ADMINISTRATIVE TOOL. They note that, In 
general the use of computers by principals Is currently very spotty, the need 
for orientation and training Is great. However, In two high schools where a 
greet effort had been made to develop usable data bases for principals, 
assi -srlnclpjls and counselors enthusiasm for the computer s potential for 
spotting trends and Identifying problems was great. 



In addition to their lack of keyboard skills, Brian Stecher lists many 
obstacles In the way of ADMINISTRATOR ACCEPTANCE of Information systems. In his 
paper, "Impediments to IIS Implementation: Superintendents Don t Type, he 
focuses on four areas: resistance to Innovation, difficulties with Information 
ut1Hzat<on uncertainty about computer education and Inadequate administrator 
preparation! Stecher descrloes how admlnlstator training can overcome these 
Impediments and gives 14 guidelines for designing administrative training. 



Pete Idsteln describes how the Christina Instructional Management System 
(CIHS) Is getting Its Information system act together. A COMPUTER NETWORK sup- 
ports a comprehensive grade-by-grade testing program to track student progress 
through a basic skills curriculum. Pete describes the development of the system 
and discusses Implementation problems related to logistics, equipment, training, 
data bases c multi-user systems, and adaptation to change. He also raises policy 
Issues related to promotion requirements, mastery learning, rights of privacy, 
equal protection and due process. 



Ken Serves writes about A COLLABORATIVE EFFORT between the Centennial 
School District (Portland. Oregon) and the Northwest Regional """tlona 
Laboratory to develop the Onward to Excellence Program (OTE). In OTE school 
staff collectively make decisions about school Improvement goals based on three 
types of student data - academic, affective, and social. 0TE Is > •J" for " a J; ° n 
support system for communication among teachers, principals and district admin- 
istrators about Instructional change. 



Bill Cooley, 1n his paper "Developing an Elementary School I 1"*°™!*°" 
System: Compi-ter Assisted Professional," reviews the need for AUTOMATED INFOR- 
MATION SYSTEMS, the goals of such a system, and the character1st.cs of an 
effective system. He tlen describes the prototype system developed by the 
Learning Research and Development Center with a Pittsburgh public elementary 

'.lOOl. 



John King's theme Is "COMPUTING IS AN ENTERTAINING HASSLE." He d scusses 
our current fascination with ever-newer technologies stimulated by supply-push 
and "demand-pull." Because of the real-life problems of getting a system up and 
running, he debunks the notion that extensive planning has to precede action, 
the key to success In computing Is the "flexible response. 



Steven Frankel, Director of the Department of Educational Accountability , 
Montgomery (MD) County Public Schools, ask* us to LOOK TO THE FUTURE but does 
not Unfit his remarks to technology as It applies to Information systems. He 
breathlessly describes new high powrr, low cost, lap-size computers . "ljular 
telephones/satellite earth stations. He speculates on the Probability for 
hi-tech companyrun schools, ric -rgues that, to prevent others from completely 
taking over the educational function In our society, educators should at east 
-run pilot projects using the new technologies He suggests that they shoulc I be 

DT?QT f i nPVlll1ng to reorganize schools to make them compatible with 21st century 

DJljOX V/V/l J technological possibilities. 

FRIENDW FMENOW FHJENDJ.Y 
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Anaheim Union High School District 

501 Crescent Way - Anaheim, CA 98203-3520 (714) 999-3558 
James Cox, Director, Research 4 Evaluation 

As a district, we are very keen on the whole issue of accountability 
and, like many districts, have sometimes gone a bit overboard In 
terms of data collection. Our primary accountability sources are 
test scores, a student survey, a teacher survey, and a parent sur- 
vey. Added to this, o' course, win be the state J»«P»^"** 
of Q'Jallty Indicators. Totally there are 83 different pieces of 
information about which schools and the district are being held 
accountable for doing so well. My work has been to bring these 83 
pieces Into some semblance of order, as building principals design 
school plans for subsequent years. Also, we are high on school 
effectiveness characteristics. This has led to significant decision- 
making on th£ part of the school principals. 




California State Department of Education 

721 Capitol Mall, Sacramento, CA 95814 ( 916 ) 322-7373 

j. Vincent Madden, Manager-Data Acqulstlon 4 Forms Control 

Claire Qulnlan, Consul tant— Data Acquisition 4 Forms/Control 

The State Department of Education Is undertaking a project to assist local 
school districts In better use of data required for state reporting. The 
Department returns certain data reported by local agencies In microcomputer 
readable form. A manual, which will suggest and Illustrate uses that can 
be made of the data, Is under development. 

The Department Is further Interested In transmittal of data from school 
districts via microcomputers. Several data collection systems are cur 
rently adapted to microcomputer format. Others are uider consideration or 
development. 



Coneio Valley Unified School District 

Office of Rese- ch, Planning, 4 Assessment, 1400 E. Janns Rd., 

Thousand Oaks, CA 9136' (805) 497-9511 

Dorothy Malnney, Director, Research, Planning 4 Assessment 

The Conejo Valley (CA) Unified School District Educational Results 
Information Systems (ERIS), a generalized District master program 
assassment plan to obtain results Information for decls.on-makers at 
all levels has been developed. This plan establishes guidelines, 
evaluates the current status of the use of educational results 
information and establishes priorities for development of additional 
parts of the system. Important components of ERIS are: the annual 
test schedule; the linkage of planning and evaluation; the elements 
of both school and district Pupil Performance Profiles; the develop- 
ment of district, school, and classroom pupil progress reports; and 
an analysis of the existing District Assessment Program. ERIS In- 
cludes the following existing assessment Programs: California 
Assessment Program; District Competency (Proficiency) Testing 
Program; District Norm-Referenced Group Achievement Testl ng Program 
Comprehensive Test of Basic Skills; College Entrance Exam nation/ 
Advanced Placement Program (CEEB/APP); Preliminary Scholast c Apt - 
tudo Test (PSAT), Scholastic Aptitude Test (SAT); The California 
State University and College English Placement Test (EPT); School 
Attitude Measure (SAM), Substance Use Survey, Secondary Schools 
Guidance Needs Assessment; The Physical Performance Test for 
California. 
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* Covin*- Valley Schools 

* 519 E. Badlllo. Covlna CA 91223 (818) 331-3371 

* Stuart J. Mandell. Director of Research and Development j 
★ 

* Presently Installing an IBM 4330 with coax linked PC 3270*5. Developing a 

* screen managed school profile using existing database. Emphasis will be on 

* the development of history files which can be used to derive trend charts 

* and graphic displays for various sub-groups. Data will be displayed using 

* a three parameter model which allows for subgroup comparisons and the sub- 

* stltutlon of variables within a parameter on demand. 



* Delaware Department of Public instruction 

* P.O. Box 1402, Dover, DE 19903 (302) 734-4583 

* Robert A. Blgelow, State Supervslor. Ed. Assessment 
* 

* I currently manage the Delaware Educational Assessment Program. He 

* are Implementing local school, on-line access to statewide achleve- 

* ment test results via state and local computer networks. We also 

* are promoting the use of DBMS concepts In combining our assessment 

* data with LEA databases to conduct local needs assessments and monl- 

* tor student performance In meeting competency requirement. Our 

* Information system Is accessible by all Delaware teachers; a major 

* problem 1s encouraging Its use. For instructional Improvement we 

* need guidance In leadership training for school-level staff In haw 

* to ask good questions and apply MIS concepts. 




* Fillmore Unified School District 

* P.O. Box 697, FMmore, CA 93015 (B05) 524-4310 

* Phyllis Jacobson, Director of Special Services 
* 

* liy office Is responsible for all program evaluation and dlstrlctwlde stan- 

* dardlzed and proficiency testing. He have had a hard time linking d&ta 

* with decisionmaking 1r» the past because of limited personnel and lack of a 

* data base system. At the present time we are Investigating a computer data 

* base which uses equipment and software common to three cf our six 

* campuses. The district Is committed to constructing a data base and then 

* using that in dlstrlctwlde decision-making, particularly In the areas of 

* bilingual education and program effectiveness. 



* Fol som-Cordova Unified School District 

* 909 Mormon Street, Folsom, CA 95630 (916)985-3042 

* Floyd H. Andrus, Director of Research and Evaluation 

* I hive been the Director of Research and Development for fifteen years. 

* During that lime, my responsibility has changed from test coordinator to a 

* complex blend of futur1ng/1nformat<on for decisionmaking. Yes, we still 

* use achievement test scores* an Important source of information. Our 

* office also has become the responsible office for micro-computer implemen- 

* tatlon In the District. He ave developed and Implemented competency exam- 

* Inatlons. He have just become responsible for enrollment projections. He 

* have much responsibility for information. 




Long Beach Unified School District 

701 Locust Ave.. Long Beach. CA 98013 436-9931. Ext. 344 
Lewis A. Prlllrwn. Director of Research (Acting) 

Am currently Acting Director of Research for the Long Beach Unified School 
District. He are using a cluster of three computers— two PC s and one XT 
with two hard disks— linked together with Ether Net. An IRMA board Is used 
to communicate with the mainframe. My primary Interest is the timely 
acquisition of district-level data Including student records, personnel 
files (both classified and certificated), and student enrollment data by 
school and by home address. 
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Oxnard School District 

831 South *B" Street, Oxnard, CA 930JO (805) 487-3918 Ext. 
John S. Marshall, Asst. Supt. Educational Services 
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As the Assistant Superintendent of Eductlonal Services for the 
District, I have responsibility for alignment of curriculum with our 
proficiency assessment program and teacher evaluation system. This 
year we have extended our student proficiency and assessment system 
to all grade levels, 1-8. Grade level expectancies and critical 
skills have been established at each grade level. Customized cri- 
terion referenced tests Intended to assess student mastery of the 
critical skills designated for each grade level have been developed 
with Items drawn from the Merrill Publishing Company's Item bank for 
their Curriculum Referenced Tests of Mastery (CRTM). 

Additionally, and perhaps of more Immediate Interest Is exploration 
of systems to use computers for school and district-level monitoring 
of student progress toward grade level objectives/competencies. 
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Palos Verde; ^Insula Unified School District 

3801 Via La Iva, Palos Verdes Est. (213) 378-9966 
Lynn Winter , Director of Research/Evaluation 

We are Interested In Incorporating testing and evaluation Into the curri- 
culum development process from planning through summatlve evaluation. Cur- 
rently we have a K-12 waiting project which has evaluation curriculum 
revision built In. Data are collected each semester from the student 
writing folders (each student In the district has two required essays per 
year which are kept In the folders and follow the student K-12) and teacher 
surveys. During the summer a teacher writing committee reviews the student 
work and surveys to determine what kinds of changes must be made In writing 
topics, rubrics, or assigned discourses and what kind support teachers need 
to continue to Implement the project. Student essays have used for the past 
two years to provide model essays of high, medium, and low points on the 
rubric and to debug the writing topics. This year, essays will be randomly 
selected for each grade level to assess students' progress In writing. 

Testing program results from the ITBS, CAP and competency tests are Inter- 
preted very cautiously with regard to curriculum Implications. The ITBS 
has been carefully documentated, Item by Item as to content coverage In 
textbooks the district Is currently using. The competency test Is con- 
structed from state and locally-developed Items that match district objec- 
tives. Items are reviewed by a teacher committee and test forms are gener- 
ated from teacher selections. These slight assurances of curriculum match 
are not done with CAP, a test that is Uttle used to make curriculum 
Improvement decisions In this district. Principals get a yearly rep^t 
that Includes all three test results and has a page of recommendations for 
reviewing their school programs. We are moving away from using summary 
dat/j, means, percentiles, and toward looking at the distribution both 
within and between schools. 



* Pepperdlne University, Graduate School of Education 

* 3415 Sepulveda Blvd., Los Angeles, CA 90034 (213) 306-5659 

* Terence Cannings, Assocla** °rofessor 
★ 

* Currently : Associate Prof, of Education teaching In the Educational 

* Computing Program at Pepperdlne University. Program Director for the 

* M.S. In Ed. Computing at Pepperdlne. Interested In: how teachers 

* use technology in classroom management and decf sTon making; how 

* administrators use technology In ongoing decision making. 
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Sisraaertto County Office cf Education Research Department 

9738 Lincoln Village Dr« , Sacremento. CA 95827 (916) 366-2610 
Linda N. Mural, Project Manager 

I an one of t*~ee ;,,ofesslonal researcher/evaluators In the Research 
Department cf the Sacremento County Office of Edu:at1on. The clients of 
our department tend to be school districts and the State Department of 
Education. We have been [jroviders of advice, services, and Information 
systems which meet the needs of managers and teachers. Four aspects of our 
work In the last couple of years: 

1. Management Information system for special education with an Intergrated 
attendance system (County SELPA). 

2. Career goals Inventory system for Intermediate and high school students 
for feeab&ck to teachers, counselors, and parents. 

3. Microcomputer based system for administering and scoring proficiency 
test, providing prescriptive feedback and monitoring student records 
(design stage at present} 

4. Scoring and test reliability system for direct writing assessment 




Santa Monica-Hal Ibu Unified School District 
172? Fourth St., Santa Monica, CA 90401 (213) 393-2785 
Harold Connolly, Curriculum Supervisor K-12 

As Curriculum Supervisor K-12 for the SanU Monica-Mai Ibu Unified 
School District, I am directly Involve* In linking test results, 
attendance data and program and teacher evaluations with decision- 
making. We are keenly Interested In developing more effl- dent 
methoJs of processing relevant data to determine the correlations 
among student populations from school to school, declining enroll- 
ment, and the effectiveness of Instructional program delivery. In 
anticipation possible school closure we have collected extensive 
demographic Oa** on our elementary school students, and we are 1n 
the beginning stages of networking all our district's schools for 
administrative data management and cable television communications 
for both management and curriculum purposes. 

* Upper Moreland Township School District 

* Terwood Road, Willow Grove, PA 19044 (215) 659-6800 

* Paul W. BecL, Superintendent 

* Enrollment approx. 3000 - Suburban Philadelphia 

* In revlous position responsible for strategic and Instructional program 

* planning. Instructional program evaluation. Currently Interested In devel- 

* opment of computer management system t*/ attempt to create data bases for 

* decisionmaking In personnel and other resources. We are currently using 

* the Prime 2550 to develop data b*ses In business functions, personnel func- 

* tlons, school management f mctlons, and In Instructional evaluation. 




* William Perm School District 

* P.O. Box 405, Yeadon, PA 19050 (215) 284-8009 

* Philip Esbrandt, Superintendent 
* 

* As a Superintendent of a school district Influenced by rapidly 

* changing conditions and shrinking resources, I know It Is Important 

* for employees at all organizational levels to have appropriate 

* Information upon which to make decisions. I believe that gathering 

* Information In the area of student achievement or business, or using 

* computers only In scheduling or grade reporting reflects an unima- 

* glnatlve use of computers and limit* how a district can deal with 

* its problems. & comprehensive program of data collection and 

* distribution of the Information In meaningful patterns will help 

* school organizations survive. 
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Robert A. Bigelow 

State Supv., Ed. Assessment 

Delaware Dept. of Public Instruc. 

P.O. Box 1402 

Dover, DE 19903 

302-736-4583 



Bob Blum 

Prog. Dir., Goal Based Ed. Program 
NWREL 
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503-248-6800 
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Assistant Superintendent, Ed. Services 

Azusa Unified School District 

546 So. Citrus Ave 
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Charter Oak Unified School District 
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New Orleans Public Schools 
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Research & Evaluation Unit 
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Program Specialist 
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pat Clark-White 
Central i a School District 
6625 LaPalma Avenue 
Buena Park, CA 90620 
805-985-6097 



Donald Cody 

Testing Coordinator 

Hollywood Beach Elementary School 

4000 Sunset Lane 

Oxnard, CA 93030 

805-985-6097 



Robert Cole 

Assistant Superintendent 
Richland School District 
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213-393-2785 
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/ 

James Cox 

Director, Research & Evaluation 
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Dir., Research, Testing & Info. Systems 
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Inqlewoc ', CA 90301 
213-419-^589 
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REPORT ON IIS/SANTA MONICA COLLABORATION 

The Santa Monica-Mallbu school district has joined with CSE 1n a 
collaborative mutually productive relationship to explore the early stages 
o' conceptualizing, developing and opiating an educational Information 
system. 

The relationship 1s Informal and 1s maintained through phone calls, 
participation at meetings, observation at meetings, participation at 
conferences, interviews and site visits, visits to vendors. The 
relationship has benefited the school district by raising questions about 
data collection that they might have overlooked, providing technical 
assistance on data analysis and interpretation, providing them with access 
to others working on similar problems. 

The relationship has also benefited the Management of Instructional 
Information Systems (MI IS) project. We have been able to: 
observe an IIS in operation; 
talk with actual users of the system; 

find out about expectations for the system and check our actual 
uses of the system; 

get users to describe the current uses of the system; 

get users to generate ideas for potential uses of the system. 
The tangible evidences of the IIS/Santa Monica rollaboration are 
contained in three places. The Taxonomy of Questions (see MI IS project 
1985 Deliverable, A TAXONOMY OF QUESTIONS ; reflects suggestions for changes 
made at a meeting of two principals, the Santa Monica system designer, and 
the superintendent of schools. The paper included in this deliverable, 
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"THE EMERGENCE OF AN INSTRUCTIONAL INFORMATION SYSTEM: A REPORT OF ONE 
DISTRICT'S EXPERIENCES/ was based on field work done in Santa Monica 
schools (see Attachment A), The paper by Will Carey, "Reactions to an 
Elementary School Office Management System," 1n the 1985 deliverable, 
INVENTING THE FUTURE: THE DEVELOPMENT OF EDUCATIONAL INFORMATION SYSTEMS , 
was an Invited presentation at the MI IS/CSE February 1985 Conference titled 
"Information Systems and School Improvement: Inventing the Future." 

Project work at Santa Monica District-Mai ibu school district reveals 
the following technical, organizational, and substantive problems: 

- How should the joint and the independent information needs of the 
local schools and the c ral office be met In relation to 1) 
inputting data, 2) moni Ing quality of data, 3) aggregating data, 
4) reporting data at the lowest possible cost and with the least 
redundancy o x equipment and personnel time? This question is being 
addressed differently by those in the data processing department of 
the central office who see their mainframe as the most efficient 
data repository, and those in the schools who are locking primarily 
at the needs of principals-as-users. 

- What revisions are needed in the recruitment, assignment, training 
and support of personnel who are involved - either directly or 
indirectly - with the information system; and how should such 
personnel shifts be handled and phased? This question at the 
moment concerns the training of clerks, implications for reclassi- 
fication, upgrading of salaries and potentially, of personnel loss 
due to more attractive salaries elsewhere. 

- What are anticipated high priority questions from teachers, 
principals, and central office the answers to which require the 
merging of existing records currently in diffe r ait locations and 
under the control of different offices? How can such merging be 
managed so it produces both routine and responsive reports? What 
actions, if any, sre implied by the information? Examples of such 
questions include: 

From teachers: 

- What prior knowledge about each student's background and 
achievement is important for us to know? 

- Is the individual student mastering learning objectives in 
various subjects? If not, why not? What should a ao? If 
so, do we need to do anything else? 
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- Are students grouped and placed appropriately within the 
class? How should we decide? What should we do? 

- Are students moving to the next class with the necessary 
knowledge, skills, attitudes in each subject area? If not, 
who should do what? 

Fro.n principals: 

- How well does each class perforin on selected measures, e.g., 
classroom tests, district-wide tests, state-mandated tests? 
What explains the variability (e.g., student characteristics, 
instructional characteristics, test or text characteris- 
tics)? What, if anything, should be done about this? 

- How (f our school's students compare with similar students in 
other schools? Jn what measures? What, if anything, should 
we do about tuis? 

From central office staff and board members: 

- How *ell do our schools' students perform on selected 
measures, e.g., CTBS, CRTS? 

- What relationship is there between selected student 
characteristics and student performance on these measures, 
eg., attendance, language, ability, measured aptitude? 

- WMt relationship is there between selected instructional 
approaches and curricular materials and student achievement? 

- Are there common patterns among outlier stude. vS? 

- What do the answers to these questions imply for action? By 
whom? By when? 
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ATTGHEMENT A 



Procedures for Doing Field Work in 
Santa Monica Unified School District 



Purpose: to identify important issues in the installation of 
school-based computers 

to identify actual uses of computer-gene rated data 

to identify desired/potential uses of computer-generated data 

Background: Santa Monica Unified School District has authorized I the 

placement of micros in the principals' offices to be used for 
administrative and instructional management purposes. 
Principals who have expressed interest now have Hardwire and 
customized software as well as the technical assistance 
services of the software developer, Will Carey. 

Several meetings have been held at which various issues have 

been raised. These include training of clerical personnel, 

time required to interpret the data, fomats for reports, 
range of uses. 



Activities: 1) get details on where all the computers are, what their 
status is in each suiool and why 

(from Will Carey - leave message at Tim Mcliulty's office); 

2) at each school, interview the principal, the clerks using 
the computer and any teachers or others who have 
used/might like to use the computer; 



3) at central office, interview: 



pupil personnel 
desegregation 
data processing 
Title I program 
special ed. 
Will Carey 



BEST COPY 
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Interview Schedule : , nncipals 



DkAR 
4/20/d5 



1. \\o\i did iou con.e to have the couputer here? 

2. What did you anticipate using it for? 

3. Who operates the computer? 

4. What data has boon entered? By whow? 
Wou long did it take to enter? 

5. What uses have you nvade of the computer? 

WHAT m - 

Administrativ e 
attendance 
enrollment 
ethnic surveys 



reports requested 
by central office 

reports requested by 
someone in school 



Instruct! onal n^ agqi^nt 
class assignment 
class grouping 
rciiediation/enri chi,.ent 
trend analysis 



BEST COPY 
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6, What uses might you make of the data? 



1. What questions occur to you that naving orgimzed data might help you 
answer? 



8. How could having computerized data be of use 
to you/ 

to clerks? 

to teachers? 

to parents? 



9. What is your reaction to having the computer in the office? 
Advantages/di sad vantages? 



10. Wha ^sues have arisen around 

staffing - w^o will do it/when? 

training - who gets trained/by whorn/when/at what cost? 



data quali ty/ppda ting/security/coordination with central office? 



maintenance and technical assistance? 



n.*ed for new/additional customized software? 



erJc best copy n 



THE EMERGENCE OF AN INSTRUCTIONAL INFORMATION SYSTEM: 
A Report of One District's Experiences 

"laine Craig 
INTRODUCTION 

In 1984 two special education teachers in a medium sized Southern 
California school district caught computer fever and decided to try their 
hands at designing a system to reduce the time and tedium involved in an 
elementary school office's attendance procedures. They had observed the 
clerks recording attendance by hand and decided that designing a com- 
puterized system would be a way to apply their newly acquired interest in 
computer technology. They didn't know how to program a computer, but they 
could follow t'ie instructions for a commercial data base management 
system. 

The attendance program they subsequently designed (referred to as the 
Attendance File) was much more efficient than the previous manual system. 
A realistic concern developed tnat the new system would result in job loss 
for cle r ks. As one of the designers put it, "Rather than scrap our litt 
i ^a, we decided lo create e student file component to our system that 
would make use of this extra clerk time" (Carey, 1985). The designers had 
observed a need in the district for infc nation to be gathered for various 
reports and decided to create a Student File component to make such 
information readily available. In addition, they decided to "throw in a 
disaster readiness component . . . and t..e district's stockbook that would 
ease warehouse ordering. An off-the-shelf word processor was also deemed 
necessary" (Carey, 1985). 
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After getting the system up and running 1n one school, they convinced 
the school district that "two special education teachers could and should 
briny the elementary school offices into the computer age and be paid for 
it H ( Carey * 1985) • Sine* the developers had created the system solely on 
their own time, the district agreed, and to date, six of the district's 
nine elementary schools have bought and installed the system, known as the 
Elementary Office Management System (EOMS). 

This success story came to the attention of our UCLA/CSE Management of 
Instructional Information Systems (MI IS) project at a conference we pre- 
sented in February 1985 called "Information Systems and School Improvement: 
Inventing the Future." The MI IS project has been studying the use of 
information systems, especially computerized ones, to collect, store, 
analyze, and distribute information related to students 1 learning for the 
purpose of improving instruction. One of the reasons we organized the con- 
ference was to bring together those who were using instructional informa- 
tion systems (IIS) and those who wanted to find out more about their use. 

The information system described above was th> focus of one of the 
conference presentations. The system was created for the Garden City 
School District which is fairly close to the UCLA campus where our project 
is based. Besides its proximity, Garden City district interested us for a 
number of other reasons: 1) The district is relatively small, and we had 
heard from several other smaller districts that they wanted to know more 
about how to acquire and install information systems with their limited 
resources, 2) Ue were especially interested to see the capabilities of a 
system that operates on commonly available microcomputers (o.g., Apple lie 
with 80 column card, two disk drives, and a printer) and doesn't require 
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major expenditures for mainframe computing equipment. 3) We had had 
numerous requests for ideas on how to use information systems to improve 
instruction and figured that we could get that kind of information from 
repeated visits to a nearby district. 4) Since the system wasn't even a 
year old, we would have the opportunity to observe aspects of the system as 
they were evolving. We would be able to talk to those involved with the 
system before it became routine. 5) We welcomed an opportunity to check on 
some ideas about IIS that we were beginning to develop based on the work we 
had done on our project so far. 

Our study involved semi-structured interviews at three differenet 
schools with two principals, two c'serks, and one resource specialist (see 
Figure 1). We also interviewed one of the developers of the system. The 
first half of this paper summarizes the responses of the clerks and 
principals who are actually using the system. This section is organized 
according to the major questions tnat guided our interviews. The second 
half of the paper discusses these results, focusing on suggestions for the 
adoption of computerized information systems end on how to encourage their 
use. 



Figure 1 

Schools and Personnel Interviewed 



Maple School 


Principal 


Clerk 


r 


Oak School 


Principal 






Elm School 




Clerk 


Resource 








Specialist 
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RESULTS OF THE STUDY 
Why Did the Schools Buy In to the System? 

The primary attractio. of the Elementary Office Managment System 
(EOMS) for each of the schools was its attendance recording/reporting 
capability. Although there was also Interest in the stockbook function and 
wordprocessing, it is clear that the system was Initially brought in to 
improve the attendance function. 

The clerk at Elm School said that the program was Installed to 
eliminate human error In attendance reporting. She had not anticipated the 
time reduction which also resulted. 

Ihe principals at both Maple and Oak schools said that the system was 
brought in primarly for attendance and secondarily for stockbook ordering. 
The principal at Oak, the school which had installed the program most 
recently, referred to Its "proven capability In attendance" as the reason 
for his school 1 s adoption of the system. Both principals also mentioned 
interest in being able to use the word processing function. 

Although both principals later described future uses of the system 
that would involve CTBS scores and other Student File data (see below), 
neither one mentioned the Student File capability as a reason for 
installing the system. The principal at Oak described the Student File 
feature as an "unknown commodity." 
How is the System Currently Being Used ? 

Attendance file . The system's primary use In all three schools we 
visited is for preparing the monthly attendance report. When we told the 
clerk at Elm school that we wanted to find out about uses of the EOMS, she 
said emphatically, "Attendance!" At each school, the Attendance File 
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program was the first one to be operational. As the principal at Oak 
described it, "We have the /'ttendarce 'down pat 1 and are 1n the process of 
entering test data Into th " dent File." 

The Attendance File also been used at each site to generate cla^s 
lists and lists with addresses and piione numbers of students for teachers. 
At Mapie School the clerk demonstrated how she could use the Attendance 
File to generate lists of students by street addresses. These lists are 
used to verify residence within the school's boundaries. 

Student file . At each school, clerks are in the process of entering 
data for the Student File program. Although the Student Files are not yet 
complete, *wo 0 f the schools report Instances of teachers requesting 
Information fr>m the Student File. At Maple School, the Special Education 
teacher asked for a list of who would be enrolled 1n Special Ed. next 
fall. At Elm, the Chapter I specialist described how she uses the system 
to identify those who qualify for Chapter I: the system is programmed to 
identify those students whose CTBS scores fall in the lowest quartile, a 
requirement for Chapter I. The Chapter I specialist noted that the ESL 
specialist also uses the system's report of CTBS scores. She uses the 
system to Identify those who score 1n the 36th percentile or above, the 
requirement to exit from the ESL program. 

At Oak School, there were no reports of use of the Student File 
program, probably because the system was so recently installed. Oak's 
principal emphasized that the system was customized to meet the particular 
needs of Oak School. He wants Information 1n the Student File that would 
relate to the school's large Limited English Proficiency (LEP) popula- 
tion. As a Title VII school, Oak gives the CTBS 1n Spanish as well as in 
English. Thus, the Student File at Oak includes the following: 
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CTBS Spanish scores 
Desegregation Block 
Transfer Code 

Primary language for the R 3C report 1n the Spring 

Categories for EO, FEP, LEP 

Reclassification from LEP to FEP 

Bilingual program 

Special Ed Placement 

Total Years at Oak 

Other uses . An unanticipated use of the system occurred during this 
school year. Elm School is scheduled tc be closed at the end of the year 
because of declining enrollment. Maple School is scheduled to receive some 
of the Elm students. One of the EOMS developers has arranged for Maple to 
receive disks with attendance records and Student File data for 
transferring Elm School students. 

The principal at Maple says that havirg this information will enable 
him to integrate the new students Into the Maple program. He plans to 
compare students at each grade level so that he can decide on the grouping 
for heterogeneous classes. For example, 1f a group of low ability students 
comes in from Elm, he can "split them up." The principal indicated that 
this task will be easier to do with the new system. 
What is the Major Advantage of Having the EOMS? 

The reduction 1n time for attendance reporting was the major advantage 
cited at each school. For example, the clerk at Maple posts attendance 
weekly, and the principal reports that producing the monthly report now 
takes 20 to 30 minutes versus a full work day before the system was 
installed. 

At Elm, the clerk now does all the attendance recording for the month 
at one time instead of weekly. She says that the report used to take four 
to five days by hand, and now it takes a little over one day. 
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What Factors have been Important for the Effective Implementation of EOMS? 

The clerks at Maple and Elm schools praise the training they got from 
the system developers. Each of them emphasized how Important 1t was to be 
able to call on one of the developers every time she had a problem. 

The two principals Interviewed had different emphases. The principal 
at Maple stressed the need to schedule uninterrupted time for the clerk to 
use the system. He explained that there 1s always plenty for her to do 1n 
the office, so until they blocked out the time, she wasn't using the system 
consistently. In terms of implementation, the principal feels that this 
conscious effort to make a time commitment was the most important factor. 

The principal at Oak emphasized the process of working with the system 
in order to see what it can do. He believes that this process stimulates 
ideas of what else the system can do. He would like to have a micro- 
computer installed in his office so he can work with the system and exploit 
its capabilities. 

The Oak School principal also plans to acquaint the teachers with 
various features of the Student r 1le program and expects that they will 
start discovering how using the system will save them time from clerical 
tasks to devote to instruction. 
What are Potential Uses for the EOMS? 

The principals had numerous responses to this question. It is 
interesting to note that their suggestions indicate that they are thinking 
of potential uses for the Student File although that program is not yet 
fully functional at either school. 

Most of the suggestions they offered were potential uses that 
principals might make of the system. Examples of their suggestions were 
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that the system might be used to: 

Provide background for parent conferences. 

Identify patterns, to flag problems. For example, you may notice that 
fourth grade language scores aren't as good as third grade. You would 
use this information to find out why a problem exists, 

[Note: One principal noted that it wouldn't be a fair use of the 
information the system provides to make a judgment about a teacher. 
There may be factors such as a disproportionate number of students 
coming from unsupervised home environments that lead to a problem. 
The information from the system indicates what potential problems may 
exist, not why they exist.] 

Identify all students who qualify for a special program. 

Identify all students who qualify to move from one program to another 
(e.g., LEP to FEP). 

Track the progress of special groups of students such as GATE, LEP, 
Title I. 

Look at strengths and weaknesses of a particular grade level and 
report the information to teachers. This type of information could 
lead to an evaluation of the curriculum and to a process of evaluating 
the match between the curriculum and the CTBS and CAP scores. 

Document program effectiveness. For example, in looking at a program 
for LEP students, one could find out how long it takes students to 
transition to English and, once they make the transition, how they 
do. 

Look at local quality indicators. 

Look at trends in language, math, and reading scores to plan for a 
changing school population. 

The principals made a limited number of suggestions of ways that 

teachers might use the system in the future: 

They could eas.ly gee information needed in filling out forms required 
b, . ie CAP, information such as how Wg each student has been in the 
school and parents 1 occupations. This would reduce time teachers have 
to spend on clerical tasks. 

Teachers will want to look at students 1 testing patterns once they 
know they are available. 

Teachers will see the advantage of having budget information available 
and ask for such information in the future. 
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What are Specific Questions You Might Ask the System to Answer? 

It should be noted that all of the potential uses described above 
contain implicit Questions that one would ask of an information system. 
Below are examples of specific questions that the principals mentioned in 
our interviews. 

Questions that might be asked about the whole school : 

How many speak English only? 
How many are LEP? 

How many have been in the school at least three years? 
How many are above/below grade level? 

Questions that might be asked about a grade level : 

What is the average growth of second graders? 

How does their average growth compare with that of third graders? 

Questions that might be asked about a specific program : 

How long does it take for students in an ESL program to make the 

transition to regular classes? 
Once they make the transition, how do they do? 
How do students in the bilingual program compare in terms of growth 

with those who are not in the program? 

Questions to find out about a specified group such as "low achievers" : 

Do they tend to come more from single parent or double parent 
families? 

What Is the average time they have been in the school? 
What is their SES? 

What is the level of education of their parents? 
What is their attendance pattern? 

DISCUSSION 

Our main purpose in conducting this study in the Garden City School 

District was to see what we could learn about the design and implementation 

of school-based instructional information systems. We hoped to begin to 

formulate answers to two basic questions: 

1. What factors influence the adoption of a computerized information 
system by schools which have never used such systems? 
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2. What factors Influence the use of an Information system for 
Instructional improvement? 

Although it would be premature to evaluate the Implementation and use 

of the EOMS at this point, 1t appears that the Initial reaction to 1t by 

the district's elementary schools, for which 1t was designed, has been very 

positive: 

Six of nine elementary schools have installed the system* 

The Attendance File program 1s fully functional at five of the 
schools. 

Four schools are in the process of entering data Into the Student 
File. 

Both clerks we Interviewed were highly enthusiastic about the ease of 
using the system (for attendance reporting) and about the time saved. 

both principals we Interviewed can articulate a number of ways ot 
using the Student File data for instructional improvement. 

So far, the evidence indicates an enthusiastic response to the 

system. In the section below, we discuss the factors which may have 

contributed to this response. 

Factors Influencing the Adoption and Use of 
Computerized Information Systems 

Part of our work on the MI IS project has been to look at the litera- 
ture from research on management Information systems (MIS) for lessons that 
might benefit the educational community which lags behind the business 
sector in Its adoption of computerized systems to aid decisionmaking. We 
have culled from the MIS literature a variety of suggestions for de^^ng 
successful Information systems (Craig 4 Bank, 1985). In analyzing the data 
from the Garden City School District study, we noted a number of practices 
which appear to follow specific guidelines suggested in the MIS litera- 
ture. Below we have listed 8 guidelines. Each guideline 1s followed by an 
example of how it 1s being Implemented in Garden City. 
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1. The designe, should Involve the user 1n the des'gn and 

implementation of the Information system (Lucas, 1975). 

The designers . " Garden City's EOMS w orked closely with the 
principals and clerks at each school on what Information to 
include 1n the system and have continued to be Involved 1n 
training, t;ruble- c hc: ting, and ,ev1s1ng ti»c system. 

2. The designer should get "clear feedback 11 from users (Kling, 1977). 

The designers are 1n weekly (and sometimes dally) contact with the 
school personnel who use the system. Clerks report that they 
contact the designers whenever there Is a problem. 

3. The designer should accept full responsibility for the success of 

the design (Kling, 1977). 

The EOMS designers are clearly Identified 1n the school district, 
and their extensive involvement 1n trie system's Implementation 
Indicates their sense of responsibility for the success of the 
design. 

h. Management should support the system with time, Interest, and 

money (Kling, 1977). 

The principals have supported the system 1n all of the ways 
described above, Including paying the costs out of their 
individual school budgets. 

5. The designer should not undertake a project which does not address 

an Important need of the Intended users (Ginzberg, 1978). 

By starting with drastically reducing the time and tedium 
associated with the attendance function, the designers clearly 
addressed an Important need of the first users of the system, the 
clerks. By offering student data such as demographic information 
and test scores at a glance, they are addressing needs of 
principals as well. 

6. The designer should stay with the project beyond the design of the 

system through the entire implementation and should gain management's 

agreement on this at the start (Ginzberg, 1978). 

Not only were the designers of the EOMS committed to the project 
through Its Implementation, they would not sell the system to a 
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school unless the principal agreed to an entire package which 
included not only the system hut the services of the designers as 
trainers and resource people. 

7. The designer should not assume an "average" use* but should draw 

each of the users Into the design process (Glnzberg, 1978). 

Each time the system was to be Installed 1n a school, the 
designers worked with the principal to determine what Information 
^ould be useful to that particular school. In other words, each 
school has a customized version of EOMS. 

8. The designer should decide at the outset if s/he 1s going to be a 

technician or a change agent. A change agent "really comes to understand 

the user; ... he keeps the user involved throughout the entire project, 

making sure the user understands where the project 1s going and contributes 

substantially to setting this direction" (Glnzberg, 1978, pp. 298-299). 

Although the designers don't appear to Identify themselves as 
"change agents," their vision of how an Information system might 
be used to Inform Instruction and their consistent Interactions 
with system users to discuss such possibilities casts them 1n that 
role. 

It is important to note that we are applying these guidelines after 
the fact. We are not Implying that the designers of the EOMS tried to 
follow prescribed recommendations for the design and Implementation of an 
"Information system. On the contrary, 1t appears that 1n the Garden City 
School District, two creative teachers identified a need that technology 
could meet, designed a system to meet the need, and stayed with the project 
in order to see that 1t fulfilled their expectations. The result of their 
process was that they ended up doing a number of things that have been 
described 1n the management literature as key factors to the success of 
information systems. 



ERJC 



53 



13 



CONCLUSIONS 

As we have noted, Instructional uses of the EOMS are largely in the 
speculative stage right now. The designers and the school principals 
expect that the system will be used to supply information that will inform 
decisions related to the instructional program. Each of them has generated 
a list of questions that the system should be able to answer. Each is 
quite enthusiastic about such uses actually occurring. 

Although it is still too early to evaluate the extent of Garden City's 

use of an information system for instructional improvement, our initial 

work in this district has led us to speculate about the process that 

results in such use. We have identified some ideas which relate to 

schools 1 use of information systems for instruction. These ideas include: 

The adoption and use of an information system is a developmental 
process. 

Hands-on experience is vital for instructional decisionmakers to 
discover what they want the system to do. 

The principal plays the key role in the information system's use to 
improve instruction. 

If information systems are to be used to improve instruction, those 
systems should be designed from the "bottom up." 

We expect these ideas, described below, to provide useful directions for 

further studies. 

A developmental process . A common pattern in the introduction of new 
technologies is to use the new technology to do what the old has done. For 
example, one of the first uses of television involved presenting "talking 
heads," essentially a radio program with the camera showing the person 
talking to the audience. Only after some experience, did people become 
skilled with the forrs of the TV medium and develop programs that 
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capitalized on th icial aspects ot the technology. Even 1n the business 
world, computers were first used for accounting and record-keeping - tasks 
that had been done before computers, just mor^ slowly* Only recently h e 
electronic spread sheets and interactive data bases been available to 
change markedly th , ways in which businesses function. 

We believe we see a s1mH</ developmental pattern i.i Garden City. The 
elementary schools are starting out with their computerized information 
-ystems to do sometlng t^ey had been doi.,g before: recording and reporting 
attendance. They are doing the job more ac.irately and much faster, a^d in 
the process are getting used to how the system functions. Now, they are 
begining t "play" with the system, experimenting with questions they can 

of the Attendance program and the Student File program. This 
experimentation is what may lead to the discovery of new instructional uses 
for the system. 

Importance of hand. -on experience . The need for hands-on experience 
seems to be pa.*t of the developmental process described above. The 
decisionmakers have to start using the technology before they are sure they 
know what they want it for. Although administrators have been trained to 
specify their objectives in advance of makin^ plans and purchases, they 
must suspend this rational process and start using the echnology in order 
to find out what it can do. Their- extensive experience in dealing with 
instructional programs can then interact with their hands-on ixpe^ience 
using the information system, i he result can be administrators creati'.g 
new ways that the system "an inform their instructional decisions. 

Thu principal 1 s role . Recent research has emphasized the importance 
of the principal's role in the adoption of innovation. We are finding this 
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factor to be true 1n i.jard to us : ng the tOMS to Inform Instruction. In 
Garden City, the school clerks spoke almost exclusively about the 
attendance function of the system, presumably since that was the function 
they used. It was only in talking to the principals that potential uses of 
the system to improve instruction were suggested. What this suggests, of 
course, is that the principal, as the instructional leader, may be the key 
factor in the use of information systems for instructional improvement. 

Bottom-up design . A final idea about the use of information systems 
to imprc e instruction deals with where the information requirements of the 
system are generated. Hathaway (1984) argues persuasively that school 
personnel will use systems when they are the ones requesting the informa- 
tion, not when the central office is the requestor. Basically, if person- 
nel at the site identify their information needs, then they v.111 be more 
likely to see the information as useful. In Garden City, the designers 
gave not only verbal commitment to developing the system from "the bottom 
up/ but they clearly involved the school staffs in the system design. 
Each person we spoke to described how t'ie system was designed to meet 
his/lier particular needs. 

It should be stressed that these conclusions are very tentative 
because our field work was conducted solely In one school district. 
However, we believe the concepts of the developmental process, hanus-on 
experience, the role of the principal, and bottom-up design would be 
important topics to include in futjre research. 
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